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also  obtain  the  asymptotic  distributions  of  the  least 
squares  estimators  of  the  different  model  parameters. 
It  is  observed  that  the  asymptotic  distribution  of  the 
least  squares  estimators  are  multivariate  normal.  Some 
numerical  experiments  are  performed  to  see  how  the 
asymptotic  results  work  for  finite  samples.  We  propose 
some  open  problems  at  the  end. 
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1.  INTRODUCTION: 

We  consider  the  following  two  dimensional  model: 

Q 

y(ra,n)  =  ^kcos(m^i  +  nfik)  +  AT(m,n); 

*=i 

for  m  =  1, . . .  M,  n  =  1, . . . ,  TV,  (1.1) 

where  A^'s  axe  unknown  real  numbers,  ’s,  fik  ’s  are 
unknown  frequencies.  For  identifiability,  we  need  to 
assume  €  ( — 7r,  7t)  and  jjPk  E  (0,7r)  and  they  are  dis¬ 
tinct.  X(m,n)  is  a  two  dimensional  (2-D)  stationary 


random  field  described  as  follows: 

P  Q 

X(m,n)=  b{i,j)e(m-i,n-  j).  (1.2) 

i=-P  j=-Q 

Here  {e(m,n)}  is  a  two  dimensional  sequence  of  inde¬ 
pendent  and  identically  distributed  ( i.i.d .)  random  vari¬ 
able  with  mean  zero  and  finite  variance.  P  and  Q  are 
arbitrary  positive  integers,  ‘q\  the  number  of  compo¬ 
nents,  is  assumed  to  be  a  known  integer.  Given  a  sam¬ 
ple  y(m ,  n);  m  =  1, . . . ,  M,  n  =  1, . . . ,  TV,  the  problem 
is  to  estimate  Ak  ’s,  Xk  ’s,  fik's  for  k  =  1, . .  .g. 

Here  X(m,n)  is  a  stationary  random  field  and 
y(m,n)  is  a  non-stationary  random  field.  To  see  how 
this  model  represents  different  textures,  the  readers  are 
referred  to  the  work  of  Mandrekar  and  Zhang  [17]  or 
Francos  et  al.  [2],  where  they  provided  nice  2-D  image 
plots  of  2/(m,n),  whose  grey  level  at  (7n,n)  is  propor¬ 
tional  to  the  value  of  y(m,  n)  and  when  it  is  corrupted 
by  independent  Gaussian  noise  field.  So  this  model  rep¬ 
resents  mixed  textures  of  regular  textures  with  noise 
pictures.  Our  problem  is  to  extract  the  regular  tex¬ 
tures  from  the  contaminated  t/(m,n).  The  problem  is 
of  interest  in  spectrographs  and  is  studied  using  group 
theoretic  methods  by  Malliavan  [15,16].  Francos  et  al. 
[2]  considered  the  Wold  type  decomposition  of  the  ran¬ 
dom  fields  due  to  Helson  and  Lowdenslager  [5,6]  but 
no  concrete  mathematical  results  were  obtained  in  that 
paper.  Mandrekar  and  Zhang  [17]  also  considered  the 
spectral  analysis  of  this  problem  under  the  following 
stationary  assumptions  on  X(m,n) 

oo  oo 

X(m,n)=  ^2  (1.3) 

*=— OO  j=— oo 
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where  {e(m,n)}  is  a  double  array  sequence  of  indepen-  2.  CONSISTENCY  OF  THE  LSE’S: 
dent  random  variables  such  that 


oo  oo 

Y  Y  <  °°> 

1——00  j=  —  oo 

E(e(m,n))  =  0,  £(|e(m,n)|r)  <  oo,  (1.4) 

for  some  constant  r  >  2.  They  proved  that  the  spec¬ 
tral  estimators  of  A’s  and  s  are  consistent  estimators 
of  the  corresponding  parameters  when  X{m,n)  satis¬ 
fies  (1.3)  and  (1.4).  Unfortunately  the  corresponding 
estimators  of  the  linear  parameters  (A’  s)  are  not  con¬ 
sistent.  Moreover,  they  could  not  obtain  the  asymptotic 
distribution  of  the  different  estimators.  Therefore,  the 
rates  of  convergence  of  those  estimators  are  not  known. 
Their  results  are  mainly  based  on  the  work  of  Lai  and 
Wei  [14],  which  is  quite  involved  mathematically.  In 
this  paper  we  mainly  consider  the  least  squares  estima¬ 
tors  (LSE’s)  of  the  different  parameters  and  study  their 
large  sample  properties. 

It  may  be  argued  that  the  assumption  of  Mandrekar 
and  Zhang  [17]  on  X(m,n)  is  somewhat  weaker  than 
ours,  because  in  our  case  P  <  oo  and  Q  <  oo  as 
defined  in  (1.2).  But  since  P  and  Q  are  arbitrary, 
therefore  (1.3)  can  be  approximated  arbitrary  closely 
by  (1.2)  with  sufficiently  large  P  and  Q ,  see  Fuller  [3]. 
Therefore,  for  all  practical  purposes  they  are  equiva¬ 
lent.  More  over  Mandrekar  and  Zhang  [17]  use  higher 
order  moment  assumptions  (r  >  2)  on  e(m,n)  to  prove 
the  necessary  consistency  results,  whereas  we  assume 
only  the  finite  second  moment  of  e(m,n),  to  prove  the 
consistency  and  the  asymptotic  normality  of  the  LSE’s 
of  all  the  unknown  parameters.  In  this  paper  the  al¬ 
most  sure  convergence  means  with  respect  to  the  usual 
Lebesgue  measure  and  it  will  be  denoted  by  a.s.  We  will 
denote  the  set  of  positive  integers  by  Z.  Also  the  nota¬ 
tion  a  =  0(6(M, TV)),  means,  \a/b(M,N)\  is  bounded 
for  all  M  and  N. 

The  rest  of  the  paper  is  organized  as  follows.  In  Sec¬ 
tion  2,  we  prove  the  strong  consistency  and  in  Section 
3  we  obtain  the  asymptotic  distributions  of  the  LSE’s 
of  the  parameters  of  the  model  (1.1),  when  q  =  1.  For 
q  >  1,  the  results  are  obtained  in  Section  4.  We  perform 
some  numerical  experiments  and  present  those  results 
in  Section  5  and  finally  we  draw  conclusions  from  our 
work  and  propose  some  open  problems  in  Section  6. 


In  this  section,  we  obtain  the  consistency  of  the 
LSE’s  of  the  unknown  parameters  of  the  model  (1.1), 
when  <7  =  1,  z.e., 

y{m,n)  =  A°cos(mX°  4-  n/z°)  +  X (m,n); 

for  m  =  1, . . .  M,n  =  1, . . .  ,iV. 

The  LSE’s  are  obtained  by  minimizing  Q{6 ),  where 

M  N 

Q(0)  —  ^  ^2  (y(m> n)  ~  Acos(m\  -f  n/i))2  .  (2.1) 

m=l  n=l 

Here  9  =  (A,  A,/i),  the  true  parameter  value  and  the 
LSE  of  6  are  denoted  by  0°  =  (A0, A0,//0)  and  0  = 
(A,  A ,/t)  respectively.  We  make  it  explicit  the  assump¬ 
tions  on  X(m,n)  as  follows. 

Assumption  1:  Let  (X(m,n)  £  Z)  be  a  stationary 
random  field  and  each  X(m,n )  can  be  represented  as 
(1.2),  (e(m,n)  6  Z}  is  a  double  array  sequence  of  i.i.d. 
random  variables  with  mean  zero  and  variance  <r2. 


We  use  the  following  lemma  to  prove  the  necessary  re¬ 
sults. 


Lemma  1  If  the  double  array  sequence  {Af(m,n); 
m,  n  £  Z)  satisfy  Assumption  1,  then 


M  N 


<X*0 


1  1 

sup|  —  —  ^2  Y.  X(77i,n)cos(ma)cog(nj9) |  0 

m~  1  n=l 

when  min{M,N} 


00. 


Proof:  See  Appendix. 

Note  that  the  Lemma  1,  is  a  very  strong  result.  It 
extends  some  of  the  existing  one  dimensional  results  of 
Hannan  [4],  Walker  [25],  Rao  and  Zhao  [22],  Kundu  [8] 
and  Kundu  and  Mitra  [12,13]  to  the  2-D  case.  It  also 
generalizes  the  multidimensional  results  of  Bai  et  al . 
[1],  Rao  et  al.  [23],  Kundu  and  Mitra  [11]  and  Kundu 
and  Gupta  [10]  in  some  sense. 

Consider  the  following  assumption  on  the  parameters 
of  the  model  (1.1),  when  <7  =  1. 
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Assumption  2:  Let  A0  be  a  arbitrary  real  number  not 
identically  equal  to  zero,  A0  £  ( — 7r,  7t)  and  /u°  £  (0,7r). 


Now  we  state  the  consistency  result  as  the  following 
theorem. 

Theorem  Is  Under  the  assumptions  1  and  2,  the  least 
squares  estimators  of  the  parameters  of  the 
model  (1.1)  when  q  =  1,  are  strongly  consistent. 

Proof  of  Theorem  1:  Expanding  (2.1),  with  the  help 
of  Lemma  1  and  using  the  similar  technique  as  of  Bai 
et  al.  [1],  the  results  can  be  obtained. 

It  is  interesting  to  observe  that  although  the  errors 
are  correlated  the  usual  LSE’s  provide  consistent  so¬ 
lutions.  For  the  general  linear  or  non-linear  models  if 
the  errors  are  correlated,  it  is  well  known  (Rao;  [20], 
Seber  and  Wild;  [24])  that  the  usual  LSE’s  are  incon¬ 
sistent.  In  the  correlated  case,  we  need  to  consider  the 
generalized  least  squares  estimators,  which  are  consis¬ 
tent.  On  the  other  hand,  theorem  1,  may  not  be  too 
surprising,  because  it  is  known  (Kundu;  [9])  that  for 
one-dimensional  frequency  model,  even  if  the  errors  are 
correlated,  the  LSE’s  are  consistent.  In  this  respect 
one  or  higher  dimensional  frequency  models  are  quite 
different  than  the  usual  non-linear  models. 


3.  ASYMPTOTIC  NORMALITY  OF  THE 
LSE’S: 


In  this  section  we  obtain  the  asymptotic  distribu¬ 
tions  of  the  least  squares  estimators  of  the  parameters 
of  the  model  (1.1)  when  q  —  1.  We  use  the  following 
notations.  The  first  derivative  of  Q(6)  is  a  1  x  3  vector 
as 


Q'(0)  = 


'SQ(e)  sq(o)  SQ(oy 
6A  ’  SX  ’  Sn 


and  the  second  derivative 

is  a  3  x  3, 

matrix  as  follows; 

S*Q{0) 

S2Q{ff) 

6A6X 

s2Q(B)  1 
SASfi 

Q"(0)  = 

S2Q(6 ) 

6X6  A 

&2Q\9) 

62Q(9) 

SX  Sy. 

S2Q(6) 
l  S»6A 

S2Q(3) 

5n&\ 

- 1 

S' 

w  ft 

•O 

Therefore  expanding  Q'{6)  around  0 °,  we  obtain 


Q'(9)  -  Q'(0°)  =  (6  -  9°)Q"{9)  (3.1) 


where  8  is  a  point  on  the  line  joining  between  the  points 
8  and  6°.  Note  that  Q'(9)  =  0  and  consider  the  3x3 
diagonal  matrix  D  as  follows. 


D  = 


M-lN-i  0  0 

0  M-iN-2  0 

0  0  M~iN~  § 


Now  (3.1)  can  be  written  as 

(9-e°)  =  -Q'(9)[Q"(§)]-1  (3.2) 

if  Qn{6)  is  a  full  rank  matrix  (see  at  the  end  of  this 
section).  Equivalently 

(8  -  0°)D-1  =  -[Q'(0O)D][D<5"(0)D]-1.  (3.3) 

Now  let’s  consider  different  elements  of  [Q'(f?°)D]. 


1 

SQ(9°) 

-2 

M  N 

771—  1  71=1 

5A 

MiN h 

cos(mX  ~f  n/i), 

1 

SQ(9°) 

2 

M  N 

Y  Yx(m>n) 

m=l  n=l 

M$N  4 

SX 

M$N  2 

Amsin(m\  -f  nfi), 

1 

SQ(6) 

2 

M  N 

Y  5Zx(m,n) 

771=1  71=1 

AfijV§  6n 

Ansm(mA  -1-  nfi). 

Using  the  central  limit  theorem  of  the  stochastic  pro¬ 
cess  (see  Fuller;  [3]),  and  using  the  following  results  of 
Mangulis  [18]  for  (5  /  0, 


1  _ n  1  _ n 
lim  -  cos2  (tj3)  —  lim  —  V*'  sin2(t/3) 

n-+oo  n  n—too  n  ' 


1 

2 


1  n  1  n  1 
lim  —  V  tcos2(t(3)  —  lim  —  tsin2(t(3)  =  - 
n— >oo  Tl z  n— *oo  nl  ^  4 

lim  ^  t2cos2(t/3)  =  lim  V**  t2sin2(t(3)  —  - 

n— ►oo  n3  "  n— +oo  n3  "  6 

1  n 

lim  —  tsin(t/3)cos(t0)  =  0 

71— ►OO  flZ 


t=  1 
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it  follows  that  [Q'(0o)D]  tends  to  a  3- variate  normal 
distribution  with  mean  vector  zero  and  the  dispersion 
matrix  2 cr2c£,  where 


p  Q 

£  Hhi)cos(i\°)cos{jn°) 
i=  —  P  j——Q 

P  Q 

5Z  b(hj)c°s(ix°)sin(jiJ°) 

i=-P  j=-Q 
P  Q 

5Z  5Z  j)sin(i\°)cos(j n°) 

i=-Pj=-Q 
P  Q 

£  b(i,  j)sin(i\°)sin(j (/?) 
i=-Pj=-Q 


+  (1) 


+ 


+  (2) 


(3.4) 


and 


■  1 

0 

0 

s  = 

0 

H°: 

.  0 

H°2 

H°: 

(3.5) 


Observe  that  because  of  theorem  1,  0  converges  to 
0°  a.s.  and 

lim  (DQ"(0)D)  =  lim  (DQ"(J°)D)  =  S. 

(3.6) 

Therefore  from  (3.3) ,  we  have  the  following  result 


Theorem  2:  Under  the  assumptions  1  and  2,  .the  lim¬ 
iting  distribution  of  [M%N%  (A  —  A0),  Aft N 2  (A  —  A0), 
-  fj,0)}  as  Min(M,N)  ->•  00,  is  a  3-variate 
normal  with  mean  vector  zero  and  covariance  matrix 
2cr2c£-1,  when  E_1  has  the  following  structure: 


£  = 


■  1 

0 

0 

0 

48  1 

36  1 

— 

7  JS* 

7  ~ao* 

0 

36  1 

48  1 

7  AO* 

7  J 

(3.7) 


Note  that  to  prove  theorem  2,  we  use  the  fact  Q'(0) 
is  a  full  rank  matrix  a.s.  for  large  M  and  N.  In  fact, 
we  have  used  DQ"(0)D  is  of  full  rank  a.s.  (see  (3.3)). 
Now  from  (3.6),  it  is  clear  that  for  large  M  and  AT, 
DQ"(0°)D  is  a  full  rank  matrix.  Since,  the  elements  of 
the  matrix  Qn(0)  are  continuous  functions  of  0  and  0 


converges  to  0°  a.s.,  therefore  DQ"(0)D  is  a  full  rank 
matrix  a.s.  for  large  M  and  N. 

From  theorem  2,  it  is  clear  that  the  LSE  of  the  am¬ 
plitude  (A’s)  is  asymptotically  independent  with  the 
LSE’s  of  the  frequencies.  Where  as,  the  LSE’s  of  the 
two  frequencies  have  a  high  negative  correlation.  The 
asymptotic  variances  of  the  LSE’s  of  A,  A  and  /z  are 
proportional  to  jfo,  3^4„a  and  respectively. 

Therefore,  it  is  immediate  that  the  convergence  rates  of 
A  and  /}  are  of  the  orders  0(M~3N~l)  and  0(M-1iV“3) 
respectively  and  both  of  them  are  faster  than  the  con¬ 
vergence  rate  of  A,  which  is  0((MN)~l).  More  over, 
the  asymptotic  variances  of  A  and  (x  are  inversely  pro¬ 
portional  to  A0  .  This  may  not  be  very  surprising,  be¬ 
cause  if  A0  is  small,  then  it  is  difficult  to  estimate  the 
frequencies. 


4.  MULTIPARAMETER  CASE: 


In  this  section  we  consider  the  model  (1.1)  for  any 
integer  q.  We  use  the  following  notations 

0\  —  (Aj,  Al,  JZl)j  •  ♦  •  5  0q  —  {Aq}\q,flq)i 

*=(01 ,...,«*) 

The  true  parameter  value  and  the  LSE’s  of  will  be 
denoted  by  and  4'  respectively.  We  investigate  the 
consistency  and  the  asymptotic  properties  of  4>,  which 
is  obtained  by  minimizing 
M  N 

r( *)  = 

m=  1  n=l 

<7 

^  Akcos(m\k  +  n/ifc) 

fc=i 

with  respect  to  We  need  the  following  assumption. 

Assumption  3:  Let  A? , . . . ,  A°p  be  arbitrary  real  num¬ 
bers  not  any  one  of  them  are  identically  equal  to  zero, 
A?,-.., A®  e  ( — 7r, 7r)  and  they  are  distinct,  similarly 
/z? , . . . ,  p*  £  (0, 7r)  and  they  are  distinct. 

The  following  result  provides  the  consistency  results  of 
the  LSE’s  of  the  model  parameter  for  the  general  case. 

Theorem  3:  Under  assumptions  1  and  3,  ^  is  a  stron¬ 
gly  consistent  estimator  of  9°, 
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Proof:  It  is  quite  similar  to  the  proof  of  Theorem  1, 
so  it  is  omitted. 

To  establish  the  asymptotic  distribution  of  we 
use  the  following  notations.  The  3 q  x  3 q  diagonal  matrix 
V  and  the  3qx3q  block  diagonal  matrix  4>_1  are  defined 
as  follows. 


where  E . 1  can  be  obtained  from  E  1  defined  in  (3.6) 
by  replacing  A °2  with  A0*  and  similarly  c*’ s  can  be 
obtained  from  c’s  defined  in  (3.4)  by  replacing  A0  and 
fjL°  with  A*  and  respectively. 

Theorem  4:  Under  the  same  assumptions  as  Theorem 
3,  (^  -  $°)V-1  converges  to  a  3<?-variate  normal  distri¬ 
bution  with  mean  vector  zero  and  the  dispersion  matrix 
2 cr2$_1,  where  V“l  and  are  as  defined  above. 

Proof:  The  proof  can  be  obtained  quite  similarly  as 
Theorem  2,  so  it  is  omitted. 


5.  NUMERICAL  EXPERIMENTS  AND 
DISCUSSIONS: 


In  this  section  we  present  some  results  of  the  numer¬ 
ical  experiments  performed  to  see  how  the  asymptotic 
results  behave  for  finite  sample  sizes.  We  performed  all 
the  experiments  in  Silicon  Graphics,  using  the  random 
deviate  generator  of  Press  et  al.  [19].  We  considered 
the  following  model: 

y(m,n)  —  4.0cos(2.0m  4-  l.On)  4-  5.0cos(2.5m  4*  1.5n) 

4-X(m,n),  (5.1) 

X(m,n)  has  the  following  form 

AT(ra,  n)  =  e(m,n)  4-  .25e(ra  —  l,n)  4-  .25e(m  4-  l,n) 


4-.25e(m,  n  -  1)  4-  .25e(m,  n  A  1) 

{e(m,n);  m  =  1, . . . ,  M,n  =  1, . . . ,  N}  are  i.i.d .  Gau¬ 
ssian  random  variables  with  mean  zero  and  finite  vari¬ 
ance  cr2.  The  stationary  random  field  X(m,n)  has 
that  particular  structure  indicates  that  the  error  at  the 
point  (m,n)  is  equally  influenced  by  the  four  equidis¬ 
tant  points  from  (m,n).  We  considered  M  =  N  = 
10,20,30,40,50  and  cr  =  .25,  .50,  .75,  1.0.  For  each 
sample  size  and  for  each  cr  we  computed  the  LSE’s  of 
Ai,A2,  Ai,  A2,/ii  and  /x2  and  observed  the  average  es¬ 
timates  and  the  average  mean  squared  errors  (MSE’s) 
over  five  hundred  replications.  We 
present  the  results  in  Tables  1-5.  We  also  report  the 
asymptotic  variances  (ASV)  for  each  parameters  for 
comparison  purposes. 

From  the  simulations  it  became  very  clear  that  as 
sample  size  increases  or  the  variance  decreases,  the  av¬ 
erage  MSE’s  and  biases  of  all  the  estimators  decrease.  It 
shows  that  all  the  estimators  are  consistent  and  asymp¬ 
totically  unbiased.  Biases  are  quite  small  even  when 
the  sample  sizes  are  quite  small.  It  is  clear  that  the 
MSE’s  of  the  estimators  of  the  non-linear  parameters 
are  smaller  than  that  of  the  linear  parameters  even  for 
small  sample  sizes.  From  the  experimental  study  also  it 
is  clear  that  the  estimation  of  the  linear  parameters  are 
more  difficult  (in  terms  of  accuracy)  compared  to  the 
non-linear  parameters.  Some  of  the  asymptotic  behav¬ 
iors  are  present  even  at  small  sample  sizes.  For  example 
if  A\  <  A2,  then  it  is  observed  that  the  MSE’s  of  fi2  and 
X2  are  smaller  than  that  of  pq  and  Ai  respectively.  It  is 
also  observed  that  as  sample  size  increases  the  MSE’s 
become  closer  to  the  asymptotic  variances,  i.e.  |ASV 
-  MSE  |  decreases.  Therefore  looking  at  the  behavior 
of  the  MSE’s  we  can  say  that  the  asymptotic  results 
can  be  used  to  draw  the  small  sample  inferences  for  the 
different  model  parameters.  In  some  of  the  cases  it  is 
observed  that  the  ASV  is  lower  than  the  corresponding 
MSE.  This  may  not  be  very  surprising,  since  we  con¬ 
sidered  only  five  hundred  replications,  it  may  be  due  to 
the  sampling  errors  (see  Karian  and  Dudewicz;  [7]). 


6.  CONCLUSIONS: 


In  this  paper  we  consider  the  estimation  of  the  pa¬ 
rameters  of  a  two  dimensional  model,  which  has  wide 
applicability  in  Statistical  Signal  Processing  and  in  Tex- 


ture  classifications.  We  study  the  asymptotic  proper¬ 
ties  of  the  LSE’s  of  the  model  parameters  and  show 
that  the  LSE’s  are  strongly  consistent.  We  also  obtain 
the  asymptotic  distributions  of  the  LSE’s,  which  pro¬ 
vides  the  rate  of  convergence  of  the  LSE’s.  This  paper 
generalizes  some  of  the  existing  one  dimensional  results 
to  the  2-D  case.  It  generalizes  some  of  the  multidimen¬ 
sional  results  also  in  certain  way.  Numerical  experi¬ 
ments  suggest  that  the  asymptotic  results  can  be  used 
to  draw  the  small  sample  inferences  for  the  linear  and 
non-linear  parameters.  We  do  not  address  one  impor¬ 
tant  problem,  namely  the  estimation  of  ‘q’.  That  is  a 
very  important  problem  in  practice.  We  may  have  to 
use  certain  information  theoretic  criteria  like  AIC,  BIC 
or  we  may  have  to  use  the  cross  validation  type  tech¬ 
nique  as  proposed  by  Rao  [21]  for  the  one-dimensional 
case.  Another  important  problem  is  to  obtain  an  ef¬ 
ficient  estimator  of  the  different  parameters  by  some 
non-iterative  technique.  Non  iterative  techniques  are 
important  for  online  implementations  or  to  use  as  ini¬ 
tial  guesses  for  any  iterative  procedures.  More  work  is 
needed  in  these  directions. 
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Proof  of  Lemma  1:  First  we  prove  the  result  when 
X(m,n)  is  replaced  by  e(m,n) 

Consider  the  following  random  variables; 

Z(ra,n)  =  e(m,n)  if  |Y(m,n)|  <  (mn)$ 

—  0  otherwise 

First  we  will  show  that  Z(m,n)  and  e(m,n)  are  equiva¬ 
lent  sequences.  Consider 

OO  OO 

E  z(m,n)} 

m=l  n=l 

OO  OO 

=  E  Ep{le(m’n)l  >  (mn)b 

m= 1 n= 1 


[20]  Rao,  C.R.  (1973),  Linear  Statistical  Inferences  and 
its  Applications ,  Wiley  and  Sons,  2nd  edition,  New 
York. 

[21]  Rao,  C.R.  (1988),  “Some  recent  developments  in 
signal  detection”,  Statistical  Decision  Theory  and 
related  Topics ,  Eds.  J.O.  Berger  and  S.S.  Gupta. 
Springer  and  Verlag. 

[22]  Rao,  C.R.  and  Zhao,  L.C.  (1993),  “Asymptotic  be¬ 
havior  of  the  maximum  likelihood  estimators  of  su¬ 
per  imposed  exponential  signals” ,  IEEE 

Trans.  Signal  Proc.V ol.  41,  pp.  1461-1463. 


[23]  Rao,  C.R.,  Zhao,  L.C.  and  Zhou,  B.  (1995),  “Max¬ 
imum  likelihood  estimation  of  2-D  superimposed 
exponential  signals” ,  IEEE  Trans.  Acoust.  Speech 
and  Signal  Proc.,  Vol.  42,  No.  7. 


Now  observe  that  there  are  at  most  2k  k  combinatio¬ 
ns  of  (m,n)’s  such  that  mn  <  2k ,  therefore  we  have 


< 


< 


< 


EEffl  e(m,n)|  >  (ran)*} 

m=  1  n=l 
oo 

E  E  p<ie(  ra,  n)|  >  r* }  [here  r=mn] 

*=1  2h~l<r<2h 
oo 

E)A2*P{|e(l,l)|  >  2(fc-1)*} 

*=1 


OO 


CYk  2* 


£|e(l,l)|2 

2(*-D§ 


k-l 


<  OO 


Here  C  is  a  constant  and  note  that  it  may  represent 
different  constant  at  different  places.  Therefore,  e(m,n) 
and  Z(m,n)  are  equivalent  sequences.  So 


P{e(ra,  n)  ^  Z(ra,  n)  i.o.}  =  0 
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Here  i.o.  means  infinitely  often.  Let  U(m,n)=Z(m,n)- 
E(Z(m,n)),  then 


1  1 

SUp  l]v  A?  EE  E(Z(m ,  n))cos(ma)cos(nl3)\ 

a'@  m=  1  n=l 

M  N 

Sj7mSEi£<z('".'»)I 

77i=l  7i=l 

Since  E(Z(m,n))  -4  0  as  M,N  -4  oo,  therefore  as  M,N 
-4  OO 


Note  that 


_1_  J_ 
NM 


M  N 

^  y  [/(m,n){cos(ma)cos(n/3) 

771=1  71=1 


-cos(ma;)cos(n/?j)}| 

1  M  N  A/T  AT 

1  v — \  rn  MN  r  , 

-  CMN  E  zl  m2N2  +  ^ 

771=1  71=1 

as  M,N  -4  oo. 


-40 


Therefore  for  large  M  and  N,  we  have 


4ee  |£?(Z(m,n))|-fO 


M  AT 


iV  M  ,  , 

771=1  71=1 

Therefore,  it  is  enough  to  prove  that 
i  i  M  N 


M  N 


supI  nmHH  U(m,n)cos(rna)cos(nl3)\  a-4‘  0 


<*,0 


771=1  71=1 


Now  for  any  fixed  e  >  0,  — 7r  <  a,  /3  <  7t  and  0  <  h  < 

— — 3-,  we  have 
4N)Z 


2(MN)  * 


y]  yy  6f(m,n)cos(ma)cos(n/3)|  >  e} 

771=1  71=1 

M  N 

<  2e~hMN‘  nn  m  ,ti)  cos(  ma)  cos  ( n0) 


M  N 


^  ^  N  M  EE  U(m,n)  x 

a'^  771=1  71=1 

cos(ma)cos(n/3)\  >  2e} 

M  N 

<  P{  max  |  — —  Y'  Y'  U(m,n)  x 

X'j<M2N2  '  N  M  Z— <  v  ‘ 

cos(maj)cos(n/3j)|  >  e} 

<  CM2N2e~{MN)!St/2. 

Since  ^tLi  ^ e~ ^  <  oo,  from  Borel  Cantelli’s  lem- 
ma,  we  have 


sup  | r—  ^2  '^U(m,n)cos(ma)cos(n/3)\  aA  0 


M  N 


771=1  71=1 


a,0'NM 

771=1  71=1 

Therefore, 


Since  \hU(m,n)cos(ma)cos(n0)\  <  1/2,  using  ex  <1  + 
x  +  x2  for  \x\  <  1/2,  we  have 


sup  |  — —  ^2  Y.  e(m)n)cos(ma)cos(nff)\  aA  0 


M  N 


M  N 


at0  N  M 


771=1  71=1 


2e-hMNc  nn  g  h  U  (  771 , 71 )  C  0  8  (  771  C*  )  C  O  8  (  71  (3  ) 


771=1  71=1 


Since  P  <  oo,  Q  <  oo  and  (6(2,  j) |  <  00,  it  proves  the 
lemma. 


<2e-hMN<{l  +  h2a2)MN . 

Now  choose  h  — - - — 3-,  therefore  for  large  M  and  N 

2  (MTV)* 


1  1  Af  AT 

P{I^M  Y,  Y*  u (m)n)cos(ma)cos(nP)\  > e} 

771=1  71=1 

<  ce~(MN)^€i2  (c  is  a  constant). 

Let  K  =  M2iV2,  choose  K  points,  0%  =  (ai,/?i), . . . , 
0K  =  (a^,/?/^),  such  that  for  each  point  0  =  (a,/3) 
e  ( — 7r, 7r),  we  have  a  point  Oj  satisfying 


““  ot\  +  |/3j  -  /J|  < 


27T 

M2AT2 
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Table  1 
M  =  N=10 


<J 

Para. 

Ax 

a2 

Ai 

a2 

M2 

.25 

LSE 

3.998 

1.500 

MSE 

1.14E-3 

7.22E-6 

2.15E-6 

2.05E-6 

ASV 

1.41E-3 

6.04E-6 

1.38E-6 

1.38E-6 

.50 

LSE 

4.000 

4.998 

2.000 

2.500 

1.000 

MSE 

5.75E-3 

2.60E-3 

3.12E-5 

8.96E-6 

3.12E-5 

ASV 

5.64E-3 

2.01E-3 

2.42E-5 

5.53E-6 

2.42E-5 

5.53E-6 

.75 

LSE 

3.992 

4.999 

2.000 

2.500 

1.000 

— iftM 

MSE 

1.25E-2 

6.02E-3 

6.63E-5 

1.87E-5 

6.27E-5 

1.82E-5 

ASV 

1.27E-2 

4.53E-3 

5.44E-5 

1.24E-5 

5.44E-5 

1.24E-5 

1.0 

LSE 

3.989 

5.005 

2.000 

2.500 

1.000 

1.500 

MSE 

2.15E-2 

1.00E-2 

1.16E-4 

3.55E-5 

1.08E-4 

3.38E-5 

ASV 

2.26E-2 

8.06E-3 

9.67E-5 

2.21E-5 

9.67E-5 

2.21E-5 

Table  2 
M  =  N  =  20 


a 

Para. 

M 

Ai 

a2 

Ml 

M2 

.25 

LSE 

4.000 

5.001 

2.000 

2.500 

1.000 

1.500 

MSE 

1.24E-4 

5.48E-4 

3.81E-7 

1.11E-7 

3.69E-7 

1.16E-7 

ASV 

3.53E-4 

1.26E-4 

3.78E-7 

8.64E-8 

3.78E-7 

8.64E-8 

.50 

LSE 

3.999 

5.002 

2.000 

2.500 

1.000 

1.500 

MSE 

5.48E-4 

3.38E-4 

1.57E-6 

3.77E-7 

1.65E-6 

3.61E-7 

ASV 

1.41E-3 

5.04E-4 

1.51E-6 

3.45E-7 

1.51E-6 

3.45E-7 

.75 

LSE 

3.997 

5.004 

2.000 

2.500 

1.000 

1.500 

MSE 

1.65E-3" 

8.00E-4 

3.15E-6 

8.81E-7 

2.94E-6 

9.91E-7 

ASV 

3.17E-3 

1.13E-3 

3.40E-6 

7.77E-7 

3.40E-6 

7.77E-7 

1.0 

LSE 

4.000 

5.005 

2.000 

2.500 

1.000 

1.500 

MSE 

2.33E-3 

1.37E-3 

6.82E-6 

1.72E-6 

6.63E-6 

1.71E-6 

ASV 

5.64E-3 

2.01E-3 

6.04E-6 

1.38E-6 

6.04E-6 

1.38E-6 

Table  3 
M  =  N  =  30 


a 

Para. 

M 

A2 

Ai 

a2 

Mi 

M2 

.25 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

5.37E-5 

3.93E-5 

8.19E-8 

2.15E-8 

7.96E-8 

1.99E-8 

ASV 

1.57E-4 

5.60E-5 

7.46E-8 

1.71E-8 

7.46E-8 

1.71E-8 

.50 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

2.16E-4 

1.51E-4 

3.09E-7 

8.27E-8 

2.80E-7 

7.79E-8 

ASV 

6.27E-4 

2.24E-4 

2.98E-7 

6.82E-8 

2.98E-7 

6.82E-8 

.75 

LSE 

4.001 

5.003 

2.000 

2.500 

1.000 

1.500 

MSE 

5.31E-4 

3.76E-4 

6.55E-7 

1.75E-7 

7.19E-7 

1.69E-7 

ASV 

1.41E-3 

5.04E-4 

6.71E-7 

1.54E-7 

6.71E-7 

1.54E-7 

1.0 

LSE 

4.001 

5.001 

2.000 

2.500 

1.000 

1.500 

MSE 

1.04E-3 

7.13E-4 

1.21E-6 

3.22E-7 

1.24E-6 

2.97E-7 

ASV 

2.51E-3 

8.95E-4 

1.19E-6 

2.73E-7 

1.19E-6 

2.73E-7 
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Table  4 
M  =  N  =  40 


a 

Para. 

At 

M 

Ai 

A2 

Ml 

M  2 

.25 

LSE 

1.500 

MSE 

1.14E-5 

2.49E-8 

5.98E-9 

2.37E-8 

6.07E-9 

ASV 

8.81E-5 

3.15E-5 

2.36E-8 

2.36E-8 

5.40E-9 

.50 

LSE 

4.001 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

6.47E-5 

7.66E-5 

9.57E-8 

2.53E-8 

9.58E-8 

2.43E-8 

ASV 

3.53E-4 

1.26E-4 

9.44E-8 

2.16E-8 

9.44E-8 

2.16E-8 

.75 

LSE 

4.000 

■3PW 

2.000 

2.500 

1.000 

1.500 

MSE 

1.20E-4 

1.78E-4 

2.11E-7 

5.69E-8 

2.04E-7 

5.94E-8 

ASV 

7.93E-4 

2.83E-4 

2.12E-7 

4.86E-8 

2.12E-7 

4.86E-8 

1.0 

LSE 

4.001 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

1.74E-4 

2.81E-4 

3.70E-7 

8.61E-8 

3.77E-7 

9.05E-8 

ASV 

1.41E-3 

5.04E-4 

3.78E-7 

8.64E-8 

3.78E-7 

8.64E-8 

Table  5 
M  =  N  =  50 


a 

Para. 

A\ 

M 

Ax 

^2 

Ml 

M2 

.25 

LSE 

3.999 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

2.00E-5 

1.37E-5 

9.05E-9 

2.48E-9 

8.65E-9 

2.33E-9 

ASV 

5.64E-5 

2.01E-5 

9.67E-9 

2.21E-9 

9.67E-9 

2.21E-9 

.50 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

5.89E-5 

4.85E-5 

3.70E-8 

1.02E-8 

3.59E-8 

9.97E-9 

ASV 

2.26E-4 

8.06E-5 

3.87E-8 

8.84E-9 

3.87E-8 

8.84E-9 

.75 

LSE 

4.000 

5.000 

2.000 

2.500 

1.000 

1.500 

MSE 

1.67E-f 

1.21E-4 

9.29E-8 

2.12E-8 

9.14E-8 

2.01E-8 

ASV 

5.08E-4 

1.81E-4 

8.70E-8 

1.99E-8 

8.70E-8 

1.99E-8 

1.0 

3.999 

4.999 

2.000 

2.500 

1.000 

1.500 

MSE 

3.15E-4 

2.34E-4 

1.80E-7 

3.76E-8 

1.59E-7 

3.89E-8 

ASV 

9.02E-4 

3.22E-4 

1.55E-7 

3.54E-8 

1.55E-7 

3.54E-8 
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